Head-wearable apparatus to generate binaural audio

ABSTRACT

Head-wearable apparatus to generate binaural audio content includes a first stem coupled to a first microphone housing that encases first front microphone and first rear microphone that generates acoustic signals, respectively. First microphone housing includes a first front port that faces downward and a first rear port that faces backwards. Apparatus includes second stem coupled to second microphone housing that encases second front microphone and second rear microphone that generate acoustic signals, respectively. Second microphone housing includes second front port that faces downward and second rear port that faces backwards. Apparatus includes binaural audio processor that includes beamformer and storage device. Beamformer generate first beamformer signal based on acoustic signals from first front microphone and first rear microphone, and second beamformer based on acoustic signals from second front microphone and second rear microphone. Storage device stores first and second beamformer signals as a two-channel file.

PRIORITY CLAIM

This application is a continuation of and claims the benefit of priorityof U.S. patent application Ser. No. 16/370,190, filed Mar. 29, 2019,which is hereby incorporated by reference herein in its entirety.

BACKGROUND

Currently, a number of consumer electronic devices are adapted tocapture audio and/or visual content. For example, a user can use thebuilt-in cameras on a mobile device to quickly capture an event ormoment occurring in the user's life.

However, the time that is required to retrieve the mobile device maystill be too lengthy to capture some events or moments that arefleeting. Users may also feel as though they have to remove themselvesfrom being present and living the event or moment in order to retrievetheir mobile device. Further, when played back, the audio portion of thecontent that was recorded using the mobile device may not adequatelyrecreate the sound as perceived by the user.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawings, which are not necessarily drawn to scale, like numeralsmay describe similar components in different views. Like numerals havingdifferent letter suffixes may represent different instances of similarcomponents. Some embodiments are illustrated by way of example, and notlimitation, in the figures of the accompanying drawings in which:

FIG. 1 illustrates a perspective view of a head-wearable apparatus togenerate binaural audio according to one example embodiment.

FIG. 2 illustrates a bottom view of the head-wearable apparatus fromFIG. 1, according to one example embodiment.

FIG. 3A-3B illustrates details of portions of one microphone housing ofthe head-wearable apparatus from FIG. 1, according to exampleembodiments.

FIG. 4 is an exemplary flow diagram of a process of generating binauralaudio using a head-wearable apparatus from FIG. 1 according to variousaspects of the disclosure.

FIG. 5 illustrates a block diagram of a system to generate binauralaudio included in the head-wearable apparatus from FIG. 1, according toone example embodiment.

FIG. 6 illustrates a block diagram of the binaural audio processorincluded in the system in FIG. 5, according to one example embodiment.

FIG. 7 is a block diagram illustrating a representative softwarearchitecture, which may be used in conjunction with various hardwarearchitectures herein described.

FIG. 8 is a block diagram illustrating components of a machine,according to some exemplary embodiments, able to read instructions froma machine-readable medium (e.g., a machine-readable storage medium) andperform any one or more of the methodologies discussed herein.

FIG. 9 is a high-level functional block diagram of an examplehead-wearable apparatus communicatively coupled a mobile device and aserver system via various networks.

DETAILED DESCRIPTION

The description that follows includes systems, methods, techniques,instruction sequences, and computing machine program products thatembody illustrative embodiments of the disclosure. In the followingdescription, for the purposes of explanation, numerous specific detailsare set forth in order to provide an understanding of variousembodiments of the inventive subject matter. It will be evident,however, to those skilled in the art, that embodiments of the inventivesubject matter may be practiced without these specific details. Ingeneral, well-known instruction instances, protocols, structures, andtechniques are not necessarily shown in detail.

To improve on audio recording that is captured by current electronicmobile devices, some embodiments of the disclosure are directed to ahead-wearable apparatus 100 that can capture audio content, which whenplayed back, is an imitation of the sound as perceived by the user ofthe head-wearable apparatus 100. Specifically, the head-wearableapparatus 100 can record audio using microphones that are arranged tocreate 3-dimensional (3D) sound sensation for the listener as if presentwhen the audio was recorded. This is called binaural audio. The playbackof the captured audio content will have the effect of binaural audiothat has the stereo separation and the spectral content that would mimica human ear and head response. The design of the head-wearable apparatus100 uses, among other things, the diffraction pattern of the human head,the placement of the microphones on both sides of the head, andbeamforming techniques.

FIG. 1 illustrates a perspective view of a head-wearable apparatus 100to generate binaural audio according to one example embodiment. FIG. 2illustrates a bottom view of the head-wearable apparatus 100 from FIG.1, according to one example embodiment. In FIG. 1 and FIG. 2, thehead-wearable apparatus 100 is a pair of eyeglasses. In someembodiments, the head-wearable apparatus 100 can be sunglasses orgoggles. Some embodiments can include one or more wearable devices, suchas a pendant with an integrated camera that is integrated with, incommunication with, or coupled to, the head-wearable apparatus 100 or aclient device. Any desired wearable device may be used in conjunctionwith the embodiments of the present disclosure, such as a watch, aheadset, a wristband, earbuds, clothing (such as a hat or jacket withintegrated electronics), a clip-on electronic device, or any otherwearable devices. It is understood that, while not shown, one or moreportions of the system included in the head-wearable apparatus can beincluded in a client device (e.g., machine 800 in FIG. 8) that can beused in conjunction with the head-wearable apparatus 100. For example,one or more elements as shown in FIG. 5 and FIG. 6 can be included inthe head-wearable apparatus 100 and/or the client device.

As used herein, the term “client device” may refer to any machine thatinterfaces to a communications network to obtain resources from one ormore server systems or other client devices. A client device may be, butis not limited to, a mobile phone, desktop computer, laptop, portabledigital assistants (PDAs), smart phones, tablets, ultra books, netbooks,laptops, multi-processor systems, microprocessor-based or programmableconsumer electronics, game consoles, set-top boxes, or any othercommunication device that a user may use to access a network.

In FIG. 1 and FIG. 2, the head-wearable apparatus 100 is a pair ofeyeglasses that includes a frame 103 that includes eye wires (or rims)that are coupled to two stems (or temples), respectively, via hingesand/or end pieces. The eye wires of the frame 103 carry or hold a pairof lenses 104_1, 104_2. The frame 103 includes a first (e.g., right)side that is coupled to the first stem and a second (e.g., left) sidethat is coupled to the second stem. The first side is opposite thesecond side of the frame 103.

The apparatus 100 further includes a camera module that includes cameralenses 102_1, 102_2 and at least one image sensor. The camera lens maybe a perspective camera lens or a non-perspective camera lens. Anon-perspective camera lens may be, for example, a fisheye lens, awide-angle lens, an omnidirectional lens, etc. The image sensor capturesdigital video through the camera lens. The images may be also be stillimage frame or a video including plurality of still image frames. Thecamera module can be coupled to the frame 103. As shown in FIGS. 1 and2, the frame 103 is coupled to the camera lenses 102_1, 102_2 such thatthe camera lenses face forward. The camera lenses 102_1, 102_2 can beperpendicular to the lenses 104_1, 104_2. The camera module can includedual-front facing cameras that are separated by the width of the frame103 or the width of the head of the user of the apparatus 100.

In FIGS. 1 and 2, the two stems (or temples) are respectively coupled tomicrophone housings 101_1, 101_2. The first and second stems are coupledto opposite sides of a frame 103 of the head-wearable apparatus 100. Thefirst stem is coupled to the first microphone housing 101_1 and thesecond stem is coupled to the second microphone housing 101_2. Themicrophone housings 101_1, 101_2 can be coupled to the stems between thelocations of the frame 103 and the temple tips. The microphone housings101_1, 101_2 can be located on either side of the user's temples whenthe user is wearing the apparatus 100.

As shown in FIG. 2, the microphone housings 101_1, 101_2 encase aplurality of microphones 110_1 to 110_N (N>1). The microphones 110_1 to110_N are air interface sound pickup devices that convert sound into anelectrical signal. More specifically, the microphones 110_1 to 110_N aretransducers that convert acoustic pressure into electrical signals(e.g., acoustic signals). Microphones 110_1 to 110_N can be digital oranalog microelectro-mechanical systems (MEMS) microphones. The acousticsignals generated by the microphones 110_1 to 110_N can be pulse densitymodulation (PDM) signals.

In FIG. 2, the first microphone housing 101_1 encases microphones 110_3and 110_4 and the second microphone housing 101_2 encases microphones110_1 and 110_2. In the first microphone housing 101_1, the first frontmicrophone 110_3 and the first rear microphone 110_4 are separated by apredetermined distance d₁ and form a first order differential microphonearray. In the second microphone housing 101_2, the second frontmicrophone 110_1 and the second rear microphone 110_2 are also separatedby a predetermined distance d₂ and form a first order differentialmicrophone array. The predetermined distances d₁ and d₂ can be the samedistance or different distances. The predetermined distances d₁ and d₂can be set based on the Nyquist frequency. Content above the Nyquistfrequency for a beamformer is irrecoverable, especially for speech. TheNyquist frequency is determined by the equation:

${Nf} = \frac{c}{2*d}$

In this equation, c is the speed of sound and d is the separationbetween the microphones. Using this equation, in one embodiment, thepredetermined distances d₁ and d₂ can be set as any value of d thatresults in a frequency above 6 kHz, which is the cutoff for Widebandspeech.

While, in FIG. 1, the system 100 includes four microphones 110_1 to110_4, the number of microphones can vary. In some embodiment, themicrophone housings 101_1, 101_2 can include at least two microphonesand can form a microphone array. Each of the microphone housings 101_1,101_2 can also include a battery.

A user naturally perceives audio with two ears separated by the headsuch that the user is able to distinguish the direction from which soundarrives. Accordingly, by placing the microphone housings 101_1, 101_2 onthe stems of the head-wearable apparatus 100, the head-wearableapparatus 100 can achieve capturing the sound as perceived by the userwearing the head-wearable apparatus 100.

Referring to FIG. 2, each of the microphone housings 101_1, 101_2includes a front port and a rear port. The front port of the firstmicrophone housing 101_1 is coupled to microphone 110_3 (e.g. firstfront microphone) and the rear port of the first microphone housing101_1 is coupled to the microphone 110_4 (e.g., first rear microphone).The front port of the second microphone housing 101_2 is coupled tomicrophone 110_1 (e.g. second front microphone) and the rear port of thesecond microphone housing 101_2 is coupled to the microphone 110_2(e.g., second rear microphone). In one embodiment, the microphones 101_1to 101_4 can be moved further towards the temple tips on the stems ofthe apparatus 100 (e.g., the back of the apparatus 100) to accentuatethe binaural effect captured by the microphones.

FIG. 3A-3B illustrates details of portions of one microphone housing ofthe head-wearable apparatus from FIG. 1, according to exampleembodiments. Specifically, FIG. 3A illustrates the details of themicrophone 110_1 (e.g. second front microphone) and the front portassociated therewith. While FIG. 3A illustrates the details of themicrophone 110_1 coupled to the front port in the second microphonehousing 101_2, it is understood that the details of the microphone 110_3(e.g., first front microphone) coupled to the front port in the firstmicrophone housing 101_1 are similar to the details in FIG. 3A.

FIG. 3A is a cutaway view of the front microphone 110_1 and the acousticpath 112. As shown, the acoustic path 112 travels through the separationbetween the chunk 114 (e.g., second microphone housing 101_2) and ahousing 113 of the second stem. The housing 113 of the stem can be madeof metal. The front microphone 110_1 and the front port are pointing (orfacing) downwards. For example, when the user is standing and wearingthe apparatus 100, the front port in FIG. 3A is open in a directiontowards the user's feet on the ground. This design allows for the frontacoustic port length and the acoustic mass to be at a minimum whilstensuring that the front microphone 110_1 is protected in a pocket thatcan reduce the effect of noise (e.g., wind noise turbulence, etc.).

FIG. 3B illustrates details of another portion of the head-wearableapparatus from FIG. 1, according to one example embodiment.Specifically, FIG. 3B illustrates the details of the microphone 110_2(e.g. second rear microphone) and the rear port associated therewith.While FIG. 3B illustrates the details of the microphone 110_2 coupled tothe rear port in the second microphone housing 101_2, it is understoodthat the details of the microphone 110_4 (e.g., first rear microphone)coupled to the rear port in the first microphone housing 101_1 aresimilar to the details in FIG. 3B.

FIG. 3B is a cutaway view of the rear microphone 110_2 and the acousticpath 112. As shown, the acoustic path 112 travels through a separationbetween the chunk 114 (e.g., second microphone housing 101_2) and ahousing 113 of the second stem. The housing 113 of the stem in FIG. 3Bcan also be made of metal. The rear microphone 110_2 and the rear portare pointing (or facing) backwards. For example, when the user iswearing the apparatus 100, the rear port in FIG. 3B is open in adirection towards the back of the user's head or the rear of theapparatus 100 (e.g., towards the temple end). With the porting beingbackwards in this embodiment, direct wind contact with the rear port isavoided when the user wears the apparatus 100. This design furtherallows for the rear acoustic port length and the acoustic mass to be ata minimum whilst ensuring that the rear microphone 110_2 is protected ina pocket that can reduce the effect of noise (e.g., wind noiseturbulence, etc.). In one embodiment, a mechanical filter can be appliedto the rear microphone 110_2 to further improve noise immunity.

As shown in FIGS. 3A-3B, the microphones 110_1 to 110_4 can be part of amicrophone assembly stackup that includes a flexible circuit board and apressure sensitive adhesive (PSA) stackup that includes a waterproofmembrane sandwiched between PSA layers. The waterproof membrane canprotect the microphones 110_1 to 110_4 from water ingress and air leaks.The PSA stackup is then coupled to a microphone assembly housing. Insome embodiments, the microphone assembly housing is the chunk 114 orthe housing 113 of the second stem.

FIG. 4 is an exemplary flow diagram of a process of generating binauralaudio using a head-wearable apparatus 100 from FIG. 1 according tovarious aspects of the disclosure. Although the flowchart may describethe operations as a sequential process, many of the operations can beperformed in parallel or concurrently. In addition, the order of theoperations may be re-arranged. A process is terminated when itsoperations are completed. A process may correspond to a method, aprocedure, etc. The steps of method may be performed in whole or inpart, may be performed in conjunction with some or all of the steps inother methods, and may be performed by any number of different systems,such as the systems described in FIG. 1 and/or FIG. 8. The process 400may also be performed by a processor included in head-wearable apparatus100 in FIG. 1 or by a processor included in a client device 800 of FIG.8.

The process 400 starts at operation 401 with microphones 110_1 to 110_4generating acoustic signals. The microphones 110_1 to 110_4 can be MEMSmicrophones that convert acoustic pressure into electrical signals(e.g., acoustic signals). The first front microphone 110_3 and the firstrear microphone 110_4 are encased in a first microphone 101_1 housingthat is coupled on a first stem of the head-wearable apparatus 100. Thefirst front microphone 110_3 and the first rear microphone 110_4 form afirst order differential microphone array. The second front microphone110_1 and the second rear microphone 110_2 are encased in a secondmicrophone housing 101_2 that is coupled on a second stem of thehead-wearable apparatus 100. The second front microphone 110_1 and thesecond rear microphone 110_2 form a first order differential microphonearray. The first and second stems are coupled to opposite sides of aframe 103 of the head-wearable apparatus 100. The acoustic signals canbe pulse density modulation (PDM) signals.

At operation 402, the audio codecs 501_1, 501_2 decode the acousticsignals from the microphones 110_1 to 110_4. The audio codec 501_2decodes the acoustic signals from the first front microphone 110_ andthe first rear microphone 110_4 to generate a first decoded acousticsignal and the audio codec 501_1 decodes the second front microphone110_1 and the second rear microphone 110_2 to generate a second decodedacoustic signal. The first and second decoded acoustic signals are pulsecode modulation (PCM) signals. The first decoded acoustic signal is aPCM signal based on the acoustic signals from the first front microphone110_3 and the first rear microphone 110_4. The second decoded acousticsignal is a PCM signal based on the acoustic signals from the secondfront microphone 110_1 and the second rear microphone 110_2.

At operation 403, the TDM 502 processes the decoded acoustic signalsfrom the audio codecs 501_1, 501_2. The TDM 502 processes the first andsecond decoded acoustic signals by time division multiplexing the firstand second decoded acoustic signals. The TDM-processed signal includesthe first decoded acoustic signal and the second decoded acousticsignal.

At operation 404, the beamformer 601 beamforms the TDM-processed signal.As further described below, the beamformer 601 can be a fixed beamformerthat includes a fixed beam patterns that is sub-cardioid or cardioid.The beamformer 601 beamforms the first decoded signal to generate afirst beamformer signal and beamforms the second decoded signal togenerate a second beamformer signal.

At operation 405, the storage device 604 stores the beamformer signalsas a two-channel file. The two-channel file can be a two-channel PCMfile or a two-channel Advanced Audio Coding (AAC)/PCM file. The storagedevice 604 can be a flash storage device.

In one embodiment, a noise suppressor 602 suppresses noise from thefirst beamformer signal and the second beamformer signal and generates afirst noise-suppressed signal and a second noise-suppressed signal. Aspeech enhancer 603 can enhance speech from the first noise-suppressedsignal and the second noise-suppressed signal to generate a first cleansignal and a second clean signal, respectively. In this embodiment, thestorage device 604 stores the first and second clean signal as atwo-channel PCM file.

FIG. 5 illustrates a block diagram of a system 500 to generate binauralaudio included in the head-wearable apparatus 100 from FIG. 1, accordingto one example embodiment. In some embodiments, one or more portions ofthe system 500 can be included in the head-wearable apparatus 100 or canbe included in a client device (e.g., machine 800 in FIG. 8) that can beused in conjunction with the head-wearable apparatus 100.

System 500 includes the microphones 110_1 to 110_N, audio codecs 501_1,501_2, a time-division multiplexer (TDM) 502, and a binary audioprocessor 503. The first front microphone 110_3 and the first rearmicrophone 110_4 encased in the first microphone housing 101_1 form afirst-order differential microphone array. Similarly, the second frontmicrophone 110_1 and the second rear microphone 110_2 encased in thesecond microphone housing 101_2 form another first-order differentialmicrophone array. The microphones 110_1 to 110_4 can be analog ordigital MEMS microphones. The acoustic signals generated by themicrophones 110_1 to 110_4 can be pulse density modulation (PDM)signals.

The audio codec 501_1 decodes the acoustic signals from the first frontmicrophone 110_3 and the first rear microphone 110_4 to generate a firstdecoded acoustic signal. The audio codec 501_2 decodes the acousticsignals from the second front microphone 110_1 and the second rearmicrophone 110_2 to generate a second decoded acoustic signal. The firstand second decoded acoustic signals can be pulse code modulation (PCM)signals. In one embodiment, the audio codecs 501_1, 501_2 decode theacoustic signals that are PDM signals from a single-bit PIM format intoa multibit pulse code modulation (PCM) format. The audio codecs 501_1,501_2 can include PDM inputs with filters that convert the PDM signalsto PCM format. In one embodiment, the audio codecs 501_1, 501_2 use amicrocontroller with a synchronous serial interface to capture the PDMdata stream from the microphones 110_1 to 110_4 and convert the PDM datastream into PCM format using the filters implemented in software.

The PCM signals can be interpreted by an interface of the binaural audioprocessor 503. In some embodiments, binaural audio processor 503 is aSilicon-on-Chip (SoC). The SoC can include an interface, such as the I2Sinterface, to receive and interpret the PCM signals.

In one embodiment, the interface of the binaural audio processor 503 canonly handle one packet (e.g., 2 channels of audio), the time-divisionmultiplexer (TDM) 502 in the system 500 receives and process the firstand second decoded acoustic signals (e.g., PCM signals) to generate aTDM-processed signal. The TDM 502 time-division multiplexes the firstand second decoded acoustic signals to generate the TDM-processedsignal. In one embodiment, the system 500 further oversamples theTDM-processed signal to allow for an input the four microphone signals.The system 500 can also include switches to create extra slots to allowfor the microphone signals.

In one embodiment, the microphones 110_1 to 110_4 are digital MEMSmicrophones. The acoustic signals generated by digital MEMS microphonesare relatively immune to noise, but signal integrity can still be aconcern due to distortion created by parasitic capacitance, resistance,and inductance between the microphones 110_1 to 110_4 outputs and theSoC such as the binaural audio processor 503. Impedance mismatches canalso create reflections that can distort the signals in applicationswith longer distances between the digital microphones 110_1 to 110_4 andthe SoC. In one embodiment, the microphones 110_1 to 110_4 are attachedto flexible circuits designed to maximize signal integrity and alsominimize the trace length between the elements. In this embodiment, theflexible circuits are encased in the microphone housings 101_1, 101_2.

FIG. 6 illustrates a block diagram of the binaural audio processor 503included in the system 500 in FIG. 5, according to one exampleembodiment. The binaural audio processor 503 includes a beamformer 601,a noise suppressor 602, a speech enhancer 603, and a storage device 604.

In one embodiment, the binaural audio processor 503 includes aninterface that receives the TDM-processed signal. As discussed above,the TDM-processed signal is generated from the acoustic signals from thefirst front microphone 110_3, the first rear microphone 110_4, thesecond front microphone 110_1 and the second rear microphone 110_2. Inone embodiment, the microphones 110_1 to 110_4 are digital MEMSmicrophones which are inherently omnidirectional.

The beamformer 601, which has direction steering properties, is adifferential beamformer that allows for a flat frequency response exceptfor the Nyquist frequency. The beamformer 601 uses the transferfunctions of a first-order differential microphone array. The transferfunctions for the first-order differential microphone array is asfollows for two microphones:

${h_{1} + {h_{2}e^{{- {jw}}\frac{d}{c}\cos\;\theta}}} = 1$${h_{1} + {h_{2}e^{{- {jw}}\frac{d}{c}\cos\;\beta}}} = 0$

In these equations above, theta θ is the angle and beta β is at 180degrees, the equation simplifies to E=A+B cos θ, for a fixed frequency(or frequency independent) beam (e.g., beamformer signal). E in thesimplified equation is the fixed frequency output of the beamformer. Inone embodiment, the beamformer 601 is a fixed beamformer that includes afixed beam pattern that is sub-cardioid with A and B coefficients of0.25 and 0.75, respectively. In one embodiment, the beamformer 601 is afixed beamformer that includes a fixed beam pattern that is cardioidwith A and B coefficients of 0.5 and 0.5, respectively.

In one embodiment, the beamformer 601 receives the acoustic signals fromthe first front microphone 110_3, the first rear microphone 110_4, thesecond front microphone 110_1 and the second rear microphone 110_2. Inone embodiment, the beamformer 601 receives the TDM-processed signal.The beamformer 601 generates a first beamformer signal based on theacoustic signals from the first front microphone 110_3 and the firstrear microphone 110_4, and a second beamformer signal based on theacoustic signals from the second front microphone 110_1 and the secondrear microphone 110_2. The storage device 604 can store the first andsecond beamformer signal as a two-channel file.

The noise suppressor 602 suppresses noise from the first beamformersignal and the second beamformer signal. The noise suppressor 602 is atwo-channel noise suppressor and generates a first noise-suppressedsignal and a second noise-suppressed signal. In one embodiment, thenoise suppressor 602 can implement a noise suppressing algorithm.

The speech enhancer 603 enhances speech from the first noise-suppressedsignal and the second noise-suppressed signal to generate a first cleansignal and a second clean signal. In one embodiment, the speech enhancer603 can implement a model-based speech enhancement. The speech enhancer603 can perform a search for a plurality of speech signatures in thefirst and second noise-suppressed signals. When the speech enhancer 603identifies portions in the first and second noise-suppressed signalsthat match at least one of the speech signatures, the speech enhancer603 enhances or emphasizes the identified portions. In one embodiment,the speech enhancer 603 can implement a speech enhancement algorithm.

The storage device 604 stores the first and second clean signal from thespeech enhancer 603 as a two-channel file. The two-channel file can be atwo-channel PCM file (or two-channel AAC/PCM file) that represents theleft and right channels. Storage device 604 can be a flash storagedevice.

FIG. 7 is a block diagram illustrating an exemplary softwarearchitecture 706, which may be used in conjunction with various hardwarearchitectures herein described. FIG. 7 is a non-limiting example of asoftware architecture and it will be appreciated that many otherarchitectures may be implemented to facilitate the functionalitydescribed herein. The software architecture 706 may execute on hardwaresuch as machine 8 of FIG. 8 that includes, among other things,processors 804, memory 814, and I/O components 818. A representativehardware layer 752 is illustrated and can represent, for example, themachine 800 of FIG. 8. The representative hardware layer 752 includes aprocessing unit 754 having associated executable instructions 704.Executable instructions 704 represent the executable instructions of thesoftware architecture 706, including implementation of the methods,components and so forth described herein. The hardware layer 752 alsoincludes memory or storage modules memory/storage 756, which also haveexecutable instructions 704. The hardware layer 752 may also compriseother hardware 758.

As used herein, the term “component” may refer to a device, physicalentity or logic having boundaries defined by function or subroutinecalls, branch points, application program interfaces (APIs), or othertechnologies that provide for the partitioning or modularization ofparticular processing or control functions. Components may be combinedvia their interfaces with other components to carry out a machineprocess. A component may be a packaged functional hardware unit designedfor use with other components and a part of a program that usuallyperforms a particular function of related functions.

Components may constitute either software components (e.g., codeembodied on a machine-readable medium) or hardware components. A“hardware component” is a tangible unit capable of performing certainoperations and may be configured or arranged in a certain physicalmanner. In various exemplary embodiments, one or more computer systems(e.g., a standalone computer system, a client computer system, or aserver computer system) or one or more hardware components of a computersystem (e.g., a processor or a group of processors) may be configured bysoftware (e.g., an application or application portion) as a hardwarecomponent that operates to perform certain operations as describedherein. A hardware component may also be implemented mechanically,electronically, or any suitable combination thereof. For example, ahardware component may include dedicated circuitry or logic that ispermanently configured to perform certain operations.

A hardware component may be a special-purpose processor, such as aField-Programmable Gate Array (FPGA) or an Application SpecificIntegrated Circuit (ASIC). A hardware component may also includeprogrammable logic or circuitry that is temporarily configured bysoftware to perform certain operations. For example, a hardwarecomponent may include software executed by a general-purpose processoror other programmable processor. Once configured by such software,hardware components become specific machines (or specific components ofa machine) uniquely tailored to perform the configured functions and areno longer general-purpose processors. It will be appreciated that thedecision to implement a hardware component mechanically, in dedicatedand permanently configured circuitry, or in temporarily configuredcircuitry (e.g., configured by software) may be driven by cost and timeconsiderations.

A processor may be, or in include, any circuit or virtual circuit (aphysical circuit emulated by logic executing on an actual processor)that manipulates data values according to control signals (e.g.,“commands”, “op codes”, “machine code”, etc.) and which producescorresponding output signals that are applied to operate a machine. Aprocessor may, for example, be a Central Processing Unit (CPU), aReduced Instruction Set Computing (RISC) processor, a ComplexInstruction Set Computing (CISC) processor, a Graphics Processing Unit(GPU), a Digital Signal Processor (DSP), an Application SpecificIntegrated Circuit (ASIC), a Radio-Frequency Integrated Circuit (RFIC)or any combination thereof. A processor may further be a multi-coreprocessor having two or more independent processors (sometimes referredto as “cores”) that may execute instructions contemporaneously.

Accordingly, the phrase “hardware component”(or “hardware-implementedcomponent”) should be understood to encompass a tangible entity, be thatan entity that is physically constructed, permanently configured (e.g.,hardwired), or temporarily configured (e.g., programmed) to operate in acertain manner or to perform certain operations described herein.Considering embodiments in which hardware components are temporarilyconfigured (e.g., programmed), each of the hardware components need notbe configured or instantiated at any one instance in time. For example,where a hardware component comprises a general-purpose processorconfigured by software to become a special-purpose processor, thegeneral-purpose processor may be configured as respectively differentspecial-purpose processors (e.g., comprising different hardwarecomponents) at different times. Software accordingly configures aparticular processor or processors, for example, to constitute aparticular hardware component at one instance of time and to constitutea different hardware component at a different instance of time. Hardwarecomponents can provide information to, and receive information from,other hardware components. Accordingly, the described hardwarecomponents may be regarded as being communicatively coupled. Wheremultiple hardware components exist contemporaneously, communications maybe achieved through signal transmission (e.g., over appropriate circuitsand buses) between or among two or more of the hardware components. Inembodiments in which multiple hardware components are configured orinstantiated at different times, communications between such hardwarecomponents may be achieved, for example, through the storage andretrieval of information in memory structures to which the multiplehardware components have access.

For example, one hardware component may perform an operation and storethe output of that operation in a memory device to which it iscommunicatively coupled. A further hardware component may then, at alater time, access the memory device to retrieve and process the storedoutput. Hardware components may also initiate communications with inputor output devices, and can operate on a resource (e.g., a collection ofinformation). The various operations of example methods described hereinmay be performed, at least partially, by one or more processors that aretemporarily configured (e.g., by software) or permanently configured toperform the relevant operations. Whether temporarily or permanentlyconfigured, such processors may constitute processor-implementedcomponents that operate to perform one or more operations or functionsdescribed herein. As used herein, “processor-implemented component”refers to a hardware component implemented using one or more processors.Similarly, the methods described herein may be at least partiallyprocessor-implemented, with a particular processor or processors beingan example of hardware. For example, at least some of the operations ofa method may be performed by one or more processors orprocessor-implemented components.

Moreover, the one or more processors may also operate to supportperformance of the relevant operations in a “cloud computing”environment or as a “software as a service” (SaaS). For example, atleast some of the operations may be performed by a group of computers(as examples of machines including processors), with these operationsbeing accessible via a network (e.g., the Internet) and via one or moreappropriate interfaces (e.g., an Application Program Interface (API)).The performance of certain of the operations may be distributed amongthe processors, not only residing within a single machine, but deployedacross a number of machines. In some exemplary embodiments, theprocessors or processor-implemented components may be located in asingle geographic location (e.g., within a home environment, an officeenvironment, or a server farm). In other exemplary embodiments, theprocessors or processor-implemented components may be distributed acrossa number of geographic locations.

In the exemplary architecture of FIG. 7, the software architecture 706may be conceptualized as a stack of layers where each layer providesparticular functionality. For example, the software architecture 706 mayinclude layers such as an operating system 702, libraries 720,applications 716 and a presentation layer 714. Operationally, theapplications 716 or other components within the layers may invokeapplication programming interface (API) API calls 708 through thesoftware stack and receive messages 712 in response to the API calls708. The layers illustrated are representative in nature and not allsoftware architectures have all layers. For example, some mobile orspecial purpose operating systems may not provide aframeworks/middleware 718, while others may provide such a layer. Othersoftware architectures may include additional or different layers.

The operating system 702 may manage hardware resources and providecommon services. The operating system 702 may include, for example, akernel 722, services 724 and drivers 726. The kernel 722 may act as anabstraction layer between the hardware and the other software layers.For example, the kernel 722 may be responsible for memory management,processor management (e.g., scheduling), component management,networking, security settings, and so on. The services 724 may provideother common services for the other software layers. The drivers 726 areresponsible for controlling or interfacing with the underlying hardware.For instance, the drivers 726 include display drivers, camera drivers,Bluetooth® drivers, flash memory drivers, serial communication. drivers(e.g., Universal Serial Bus (USB) drivers), Wi-Fi® drivers, audiodrivers, power management drivers, and so forth depending on thehardware configuration.

The libraries 720 provide a common infrastructure that is used by theapplications 916 or other components or layers. The libraries 720provide functionality that allows other software components to performtasks in an easier fashion than to interface directly with theunderlying operating system 702 functionality (e.g., kernel 722,services 724 or drivers 726). The libraries 720 may include systemlibraries 744 (e.g., C standard library) that may provide functions suchas memory allocation functions, string manipulation functions,mathematical functions, and the like. In addition, the libraries 720 mayinclude API libraries 946 such as media libraries (e.g., libraries tosupport presentation and manipulation of various media format such asMPREG4, H.264, MP3, AAC, AMR, JPG, PNG), graphics libraries (e.g., anOpenGL framework that may be used to render 2D and 3D in a graphiccontent on a display), database libraries (e.g., SQLite that may providevarious relational database functions), web libraries (e.g., WebKit thatmay provide web browsing functionality), and the like. The libraries 720may also include a wide variety of other libraries 748 to provide manyother APIs to the applications 716 and other softwarecomponents/modules.

The frameworks/middleware 718 (also sometimes referred to as middleware)provide a higher-level common infrastructure that may be used by theapplications 716 or other software components/modules. For example, theframeworks/middleware 718 may provide various graphic user interface(GUI) functions, high-level resource management, high-level locationservices, and so forth. The frameworks/middleware 718 may provide abroad spectrum of other APIs that may be utilized by the applications716 or other software components/modules, some of which may be specificto a particular operating system 702 or platform.

The applications 716 include built-in applications 738 or third-partyapplications 940. Examples of representative built-in applications 738may include, but are not limited to, a contacts application, a browserapplication, a book reader application, a location application, a mediaapplication, a messaging application, or a game application. Third-partyapplications 740 may include an application developed using softwaredevelopment kit (SDK) by an entity other than the vendor of theparticular platform and may be mobile software running on a mobileoperating system. The third-party applications 740 may invoke the APIcalls 708 provided by the mobile operating system (such as operatingsystem 702) to facilitate functionality described herein.

The applications 716 may use built in operating system functions (e.g.,kernel 722, services 724 or drivers 726), libraries 720, andframeworks/middleware 718 to create user interfaces to interact withusers of the system. Alternatively, or additionally, in some systemsinteractions with a user may occur through a presentation layer, such aspresentation layer 714. In these systems, the application/component“logic” can be separated from the aspects of the application/componentthat interact with a user.

FIG. 8 is a block diagram illustrating components (also referred toherein as “modules”) of a machine 800, according to some exemplaryembodiments, able to read instructions from a machine-readable medium(e.g., a machine-readable storage medium) and perform any one or more ofthe methodologies discussed herein. Specifically, FIG. 8 shows adiagrammatic representation of the machine 800 in the example form of acomputer system, within which instructions 810 (e.g., software, aprogram, an application, an applet, an app, or other executable code)for causing the machine 800 to perform any one or more of themethodologies discussed herein may be executed. As such, theinstructions 810 may be used to implement modules or componentsdescribed herein. The instructions 810 transform the general,non-programmed machine 800 into a particular machine 800 programmed tocarry out the described and illustrated functions in the mannerdescribed. In alternative embodiments, the machine 800 operates as astandalone device or may be coupled (e.g., networked) to other machines.In a networked deployment, the machine 800 may operate in the capacityof a server machine or a client machine in a server-client networkenvironment, or as a peer machine in a peer-to-peer (or distributed)network environment. The machine 800 may comprise, but not be limitedto, a server computer, a client computer, a personal computer (PC), atablet computer, a laptop computer, a netbook, a set-top box (STB), apersonal digital assistant (PDA), an entertainment media system, acellular telephone, a smart phone, a mobile device, a wearable device(e.g., a smart watch), a smart home device (e.g., a smart appliance),other smart devices, a web appliance, a network router, a networkswitch, a network bridge, or any machine capable of executing theinstructions 810, sequentially or otherwise, that specify actions to betaken by machine 800. Further, while only a single machine 800 isillustrated, the term “machine” shall also be taken to include acollection of machines that individually or jointly execute theinstructions 1010 to perform any one or more of the methodologiesdiscussed herein.

The machine 800 may include processors 804, memory memory/storage 806,and I/O components 818, which may be configured to communicate with eachother such as via a bus 802. The memory/storage 806 may include a memory814, such as a main memory, or other memory storage, and a storage unit816, both accessible to the processors 804 such as via the bus 802. Thestorage unit 816 and memory 814 store the instructions 810 embodying anyone or more of the methodologies or functions described herein. Theinstructions 810 may also reside, completely or partially, within thememory 814, within the storage unit 816, within at least one of theprocessors 804 (e.g., within the processor's cache memory), or anysuitable combination thereof, during execution thereof by the machine800. Accordingly, the memory 814, the storage unit 816, and the memoryof processors 804 are examples of machine-readable media.

As used herein, the term “machine-readable medium,” “computer-readablemedium,” or the like may refer to any component, device or othertangible media able to store instructions and data temporarily orpermanently. Examples of such media may include, but is not limited to,random-access memory (RAM), read-only memory (ROM), buffer memory, flashmemory, optical media, magnetic media, cache memory, other types ofstorage (e.g., Erasable Programmable Read-Only Memory (EEPROM)) or anysuitable combination thereof. The term “machine-readable medium” shouldbe taken to include a single medium or multiple media (e.g., acentralized or distributed database, or associated caches and servers)able to store instructions. The term “machine-readable medium” may alsobe taken to include any medium, or combination of multiple media, thatis capable of storing instructions (e.g., code) for execution by amachine, such that the instructions, when executed by one or moreprocessors of the machine, cause the machine to perform any one or moreof the methodologies described herein. Accordingly, a “machine-readablemedium” may refer to a single storage apparatus or device, as well as“cloud-based” storage systems or storage networks that include multiplestorage apparatus or devices. The term “machine-readable medium”excludes signals per se.

The I/O components 818 may include a wide variety of components toprovide a user interface for receiving input, providing output,producing output, transmitting information, exchanging information,capturing measurements, and so on. The specific I/O components 818 thatare included in the user interface of a particular machine 800 willdepend on the type of machine. For example, portable machines such asmobile phones will likely include a touch input device or other suchinput mechanisms, while a headless server machine will likely notinclude such a touch input device. It will be appreciated that the I/Ocomponents 818 may include many other components that are not shown inFIG. 8. The I/O components 818 are grouped according to functionalitymerely for simplifying the following discussion and the grouping is inno way limiting. In various exemplary embodiments, the I/O components818 may include output components 826 and input components 828. Theoutput components 826 may include visual components (e.g., a displaysuch as a plasma display panel (PDP), a light emitting diode (LED)display, a liquid crystal display (LCD), a projector, or a cathode raytube (CRT)), acoustic components (e.g., speakers), haptic components(e.g., a vibratory motor, resistance mechanisms), other signalgenerators, and so forth. The input components 828 may includealphanumeric input components (e.g., a keyboard, a touch screenconfigured to receive alphanumeric input, a photo-optical keyboard, orother alphanumeric input components), point based input components(e.g., a mouse, a touchpad, a trackball, a joystick, a motion sensor, orother pointing instrument), tactile input components (e.g., a physicalbutton, a touch screen that provides location or force of touches ortouch gestures, or other tactile input components), audio inputcomponents (e.g., a microphone), and the like. The input components 828may also include one or more image-capturing devices, such as a digitalcamera for generating digital images or video.

In further exemplary embodiments, the I/O components 818 may includebiometric components 830, motion components 834, environmentalenvironment components 836, or position components 838, as well as awide array of other components. One or more of such components (orportions thereof) may collectively be referred to herein as a “sensorcomponent” or “sensor” for collecting various data related to themachine 800, the environment of the machine 800, a user of the machine800, or a combination thereof.

For example, the biometric components 830 may include components todetect expressions (e.g., hand expressions, facial expressions, vocalexpressions, body gestures, or eye tracking), measure biosignals (e.g.,blood pressure, heart rate, body temperature, perspiration, or brainwaves), identify a person (e.g., voice identification, retinalidentification, facial identification, fingerprint identification, orelectroencephalogram-based identification), and the like. The motioncomponents 834 may include acceleration sensor components (e.g.,accelerometer), gravitation sensor components, velocity sensorcomponents (e.g., speedometer), rotation sensor components (e.g.,gyroscope), and so forth. The environment components 836 may include,for example, illumination sensor components (e.g., photometer),temperature sensor components (e.g., one or more thermometer that detectambient temperature), humidity sensor components, pressure sensorcomponents (e.g., barometer), acoustic sensor components (e.g., one ormore microphones that detect background noise), proximity sensorcomponents (e.g., infrared sensors that detect nearby objects), gassensors (e.g., gas detection sensors to detection concentrations ofhazardous gases for safety or to measure pollutants in the atmosphere),or other components that may provide indications, measurements, orsignals corresponding to a surrounding physical environment. Theposition components 838 may include location sensor components (e.g., aGlobal Position system (GPS) receiver component), altitude sensorcomponents (e.g., altimeters or barometers that detect air pressure fromwhich altitude may be derived), orientation sensor components (e.g.,magnetometers), and the like. For example, the location sensor componentmay provide location information associated with the system 800, such asthe system's 800 GPS coordinates or information regarding a location thesystem 1000 is at currently (e.g., the name of a restaurant or otherbusiness).

Communication may be implemented using a wide variety of technologies.The I/O components 818 may include communication components 840 operableto couple the machine 800 to a network 832 or devices 820 via coupling822 and coupling 824 respectively. For example, the communicationcomponents 840 may include a network interface component or othersuitable device to interface with the network 832. In further examples,communication components 840 may include wired communication components,wireless communication components, cellular communication components,Near Field Communication (NFC) components, Bluetooth® components (e.g.,Bluetooth® Low Energy), Wi-Fi® components, and other communicationcomponents to provide communication via other modalities. The devices820 may be another machine or any of a wide variety of peripheraldevices (e.g., a peripheral device coupled via a Universal Serial Bus(USB)).

Moreover, the communication components 840 may detect identifiers orinclude components operable to detect identifiers. For example, thecommunication components 840 may include Radio Frequency Identification(RFID) tag reader components, NFC smart tag detection components,optical reader components (e.g., an optical sensor to detectone-dimensional bar codes such as Universal Product Code (UPC) bar code,multi-dimensional bar codes such as Quick Response (QR) code, Azteccode, Data Matrix, Dataglyph, MaxiCode, PDF417, Ultra Code, UCC RSS-2Dbar code, and other optical codes), or acoustic detection components(e.g., microphones to identify tagged audio signals). In addition, avariety of information may be derived via the communication components840, such as, location via Internet Protocol (IP) geo-location, locationvia Wi-Fi® signal triangulation, location via detecting an NFC beaconsignal that may indicate a particular location, and so forth.

FIG. 9 is a high-level functional block diagram of an examplehead-wearable apparatus 100 communicatively coupled a mobile device 800and a server system 998 via various networks.

Apparatus 100 includes a camera, such as at least one of visible lightcamera 950, infrared emitter 951 and infrared camera 952. The camera caninclude the camera module with the lens 104_1, 104_2 in FIGS. 1 and 2.

Client device 800 can be capable of connecting with apparatus 100 usingboth a low-power wireless connection 925 and a high-speed wirelessconnection 937. Client device 800 is connected to server system 998 andnetwork 995. The network 995 may include any combination of wired andwireless connections.

Apparatus 100 further includes two image displays of the opticalassembly 980A-B. The two image displays 980A-980B include one associatedwith the left lateral side and one associated with the right lateralside of the apparatus 100. Apparatus 100 also includes image displaydriver 942, image processor 912, low-power circuitry 920, and high-speedcircuitry 930. Image display of optical assembly 980A-B are forpresenting images and videos, including an image that can include agraphical user interface to a user of the apparatus 100.

Image display driver 942 commands and controls the image display of theoptical assembly 980A-B. Image display driver 942 may deliver image datadirectly to the image display of the optical assembly 980A-B forpresentation or may have to convert the image data into a signal or dataformat suitable for delivery to the image display device. For example,the image data may be video data formatted according to compressionformats, such as H. 264 (MPEG-4 Part 10), HEVC, Theora, Dirac, RealVideoRV40, VP8, VP9, or the like, and still image data may be formattedaccording to compression formats such as Portable Network Group (PNG),Joint Photographic Experts Group (JPEG), Tagged Image File Format (TIFF)or exchangeable image file format (Exif) or the like.

As noted above, apparatus 100 includes a frame 103 and stems (ortemples) extending from a lateral side of the frame 103. Apparatus 100further includes a user input device 991 (e.g., touch sensor or pushbutton) including an input surface on the apparatus 100. The user inputdevice 991 (e.g., touch sensor or push button) is to receive from theuser an input selection to manipulate the graphical user interface ofthe presented image.

The components shown in FIG. 9 for the apparatus 100 are located on oneor more circuit boards, for example a PCB or flexible PCB, in the rimsor temples. Alternatively or additionally, the depicted components canbe located in the chunks, frames, hinges, or bridge of the apparatus100. Left and right visible light cameras 950 can include digital cameraelements such as a complementary metal-oxide-semiconductor (CMOS) imagesensor, charge coupled device, a lens 104_1, 104_2, or any otherrespective visible or light capturing elements that may be used tocapture data, including images of scenes with unknown objects.

Apparatus 100 includes a memory 934 which stores instructions to performa subset or all of the functions described herein for generatingbinaural audio content. Memory 934 can also include storage device 604.The exemplary process illustrated in the flowchart in FIG. 4 can beimplemented in instructions stored in memory 934.

As shown in FIG. 9, high-speed circuitry 930 includes high-speedprocessor 932, memory 934, and high-speed wireless circuitry 936. In theexample, the image display driver 942 is coupled to the high-speedcircuitry 930 and operated by the high-speed processor 932 in order todrive the left and right image displays of the optical assembly 980A-B.High-speed processor 932 may be any processor capable of managinghigh-speed communications and operation of any general computing systemneeded for apparatus 100. High-speed processor 932 includes processingresources needed for managing high-speed data transfers on high-speedwireless connection 937 to a wireless local area network (WLAN) usinghigh-speed wireless circuitry 936. In certain examples, the high-speedprocessor 932 executes an operating system such as a LINUX operatingsystem or other such operating system of the apparatus 100 and theoperating system is stored in memory 934 for execution. In addition toany other responsibilities, the high-speed processor 932 executing asoftware architecture for the apparatus 100 is used to manage datatransfers with high-speed wireless circuitry 936. In certain examples,high-speed wireless circuitry 936 is configured to implement Instituteof Electrical and Electronic Engineers (IEEE) 802.11 communicationstandards, also referred to herein as Wi-Fi. In other examples, otherhigh-speed communications standards may be implemented by high-speedwireless circuitry 936.

Low-power wireless circuitry 924 and the high-speed wireless circuitry936 of the apparatus 100 can include short range transceivers(Bluetooth™) and wireless wide, local, or wide area network transceivers(e.g., cellular or WiFi). Client device 800, including the transceiverscommunicating via the low-power wireless connection 925 and high-speedwireless connection 937, may be implemented using details of thearchitecture of the apparatus 100, as can other elements of network 995.

Memory 934 includes any storage device capable of storing various dataand applications, including, among other things, camera data generatedby the left and right visible light cameras 950, infrared camera 952,and the image processor 912, as well as images generated for display bythe image display driver 942 on the image displays of the opticalassembly 980A-B. While memory 934 is shown as integrated with high-speedcircuitry 930, in other examples, memory 934 may be an independentstandalone element of the apparatus 100. In certain such examples,electrical routing lines may provide a connection through a chip thatincludes the high-speed processor 932 from the image processor 912 orlow-power processor 922 to the memory 934. In other examples, thehigh-speed processor 932 may manage addressing of memory 934 such thatthe low-power processor 922 will boot the high-speed processor 932 anytime that a read or write operation involving memory 934 is needed.

As shown in FIG. 9, the processor 932 of the apparatus 100 can becoupled to the camera (visible light cameras 950; infrared emitter 951,or infrared camera 952), the image display driver 942, the user inputdevice 991 (e.g., touch sensor or push button), and the memory 934.

Apparatus 100 is connected with a host computer. For example, theapparatus 100 is paired with the client device 800 via the high-speedwireless connection 937 or connected to the server system 998 via thenetwork 995. Server system 998 may be one or more computing devices aspart of a service or network computing system, for example, that includea processor, a memory, and network communication interface tocommunicate over the network 995 with the client device 800 andapparatus 100.

The client device 800 includes a processor and a network communicationinterface coupled to the processor. The network communication interfaceallows for communication over the network 925 or 937. Client device 800can further store at least portions of the instructions for generating abinaural audio content in the client device 800's memory to implementthe functionality described herein.

Output components of the apparatus 100 include visual components, suchas a display such as a liquid crystal display (LCD), a plasma displaypanel (PDP), a light emitting diode (LED) display, a projector, or awaveguide. The image displays of the optical assembly are driven by theimage display driver 942. The output components of the apparatus 100further include acoustic components (e.g., speakers), haptic components(e.g., a vibratory motor), other signal generators, and so forth. Theinput components of the apparatus 100, the client device 800, and serversystem 998, such as the user input device 991, may include alphanumericinput components (e.g., a keyboard, a touch screen configured to receivealphanumeric input, a photo-optical keyboard, or other alphanumericinput components), point-based input components (e.g., a mouse, atouchpad, a trackball, a joystick, a motion sensor, or other pointinginstruments), tactile input components (e.g., a physical button, a touchscreen that provides location and force of touches or touch gestures, orother tactile input components), audio input components (e.g., amicrophone), and the like.

Apparatus 100 may optionally include additional peripheral deviceelements. Such peripheral device elements may include biometric sensors,additional sensors, or display elements integrated with apparatus 100.For example, peripheral device elements may include any I/O componentsincluding output components, motion components, position components, orany other such elements described herein.

For example, the biometric components include components to detectexpressions (e.g., hand expressions, facial expressions, vocalexpressions, body gestures, or eye tracking), measure biosignals (e.g.,blood pressure, heart rate, body temperature, perspiration, or brainwaves), identify a person (e.g., voice identification, retinalidentification, facial identification, fingerprint identification, orelectroencephalogram based identification), and the like. The motioncomponents include acceleration sensor components (e.g., accelerometer),gravitation sensor components, rotation sensor components (e.g.,gyroscope), and so forth. The position components include locationsensor components to generate location coordinates (e.g., a GlobalPositioning System (GPS) receiver component), WiFi or Bluetooth™transceivers to generate positioning system coordinates, altitude sensorcomponents (e.g., altimeters or barometers that detect air pressure fromwhich altitude may be derived), orientation sensor components (e.g.,magnetometers), and the like. Such positioning system coordinates canalso be received over wireless connections 925 and 937 from the clientdevice 800 via the low-power wireless circuitry 924 or high-speedwireless circuitry 936.

Where a phrase similar to “at least one of A, B, or C,” “at least one ofA, B, and C,” “one or more A, B, or C,” or “one or more of A, B, and C”is used, it is intended that the phrase be interpreted to mean that Aalone may be present in an embodiment, B alone may be present in anembodiment, C alone may be present in an embodiment, or that anycombination of the elements A, B and C may be present in a singleembodiment; for example, A and B, A and C, B and C, or A and B and C.

Changes and modifications may be made to the disclosed embodimentswithout departing from the scope of the present disclosure. These andother changes or modifications are intended to be included within thescope of the present disclosure, as expressed in the following claims.

What is claimed is:
 1. A head-wearable apparatus comprising: a frame; afirst stem coupled to a first side of the frame and to a firstmicrophone housing that encases a first front microphone and a firstrear microphone that generate acoustic signals, respectively, a secondstem coupled to a second side of the frame and to a second microphonehousing that encases a second front microphone and a second rearmicrophone that generate acoustic signals, respectively; and a binauralaudio processor that includes a beamformer to receive the acousticsignals from the first front microphone, the first rear microphone, thesecond front microphone and the second rear microphone, and to generatea first beamformer signal based on the acoustic signals from the firstfront microphone and the first rear microphone, and a second beamformersignal based on the acoustic signals from the second front microphoneand the second rear microphone, and a storage device to store the firstbeamformer signal and the second beamformer signal as a two-channelfile.
 2. The head-wearable apparatus of claim 1, wherein the firstmicrophone housing includes a first front port that faces downward and afirst rear port that faces backwards, and the second microphone housingincludes a second front port that faces downward and a second rear portthat faces backwards.
 3. The head-wearable apparatus of claim 2, whereinthe wearable apparatus is a pair of eyeglasses, wherein the first sideof the frame is opposite the second side of the frame, wherein when thepair of eyeglasses are worn by a user, the first and second front portsface downward towards the user's feet and the first and second rearports face towards back of the user's head.
 4. The head-wearableapparatus of claim 3, wherein the frame carries a pair of lenses and iscoupled to a camera, wherein a camera lens of the camera faces forward.5. The head-wearable apparatus of claim 1, wherein the beamformer is afixed beamformer, wherein the fixed beamformer includes a fixed beampattern that is sub-cardioid or cardioid.
 6. The head-wearable apparatusof claim 1, wherein the first front microphone and the first rearmicrophone form a first order differential microphone array, and thesecond front microphone and the second rear microphone form a firstorder different microphone array.
 7. The head-wearable apparatus ofclaim 1, wherein the storage device is a flash storage device.
 8. Thehead-wearable apparatus of claim 1, wherein the binaural audio processoris a Silicon-on-Chip (SoC).
 9. The head-wearable apparatus of claim 1,further comprising: a first audio codec to decode the acoustic signalsfrom the first front microphone and the first rear microphone togenerate a first decoded acoustic signal; a second audio codec to decodethe acoustic signals from the second front microphone and the secondrear microphone to generate a second decoded acoustic signal.
 10. Thehead-wearable apparatus of claim 9, further comprising: a time-divisionmultiplexer (TDM) to process the first decoded acoustic signal and thesecond decoded acoustic signal and to generate a TDM-processed signal.11. The head-wearable apparatus of claim 10, wherein the acousticsignals generated by the first and second front microphones and thefirst and second rear microphones are pulse density modulation (PDM)signals.
 12. The head-wearable apparatus of claim 11, wherein the firstand second decoded acoustic signals are pulse code modulation (PCM)signals.
 13. The head-wearable apparatus of claim 12, wherein thebinaural audio processor further comprises: a noise suppressor tosuppress noise from the first beamformer signal and the secondbeamformer signal and to generate a first noise-suppressed signal and asecond noise-suppressed signal.
 14. The head-wearable apparatus of claim13, wherein the binaural audio processor further comprises: a speechenhancer to enhance speech from the first noise-suppressed signal andthe second noise-suppressed signal to generate a first clean signal anda second clean signal, wherein the storage device stores the first andsecond clean signal.
 15. A pair of eyeglasses comprising: a frame tocarry a pair of lenses; a camera coupled to the frame, wherein a cameralens of the camera faces in a forward direction; a first stem coupled toa first side of the frame and to a first microphone housing that encasesa first front microphone and a first rear microphone that generateacoustic signals, respectively, a second stem coupled to a second sideof the frame and to a second microphone housing that encases a secondfront microphone and a second rear microphone that generate acousticsignals, respectively; a binaural audio processor that includes abeamformer to generate a first beamformer signal based on the acousticsignals from the first front microphone and the first rear microphone,and a second beamformer signal based on the acoustic signals from thesecond front microphone and the second rear microphone, and a storagedevice to store the first beamformer signal and the second beamformersignal as a two-channel file.
 16. The pair of eyeglasses of claim 15,wherein the first microphone housing includes a first front port thatfaces in a downward direction and a first rear port that faces in abackwards direction, and the second microphone housing includes a secondfront port that faces in the downward direction and a second rear portthat faces in the backwards direction.
 17. The pair of eyeglasses ofclaim 16, wherein the beamformer is a fixed beamformer, wherein thefixed beamformer includes a fixed beam pattern that is sub-cardioid orcardioid.
 18. The pair of eyeglasses of claim 16, further comprising: afirst audio codec to decode the acoustic signals from the first frontmicrophone and the first rear microphone to generate a first decodedacoustic signal, a second audio codec to decode the acoustic signalsfrom the second front microphone and the second rear microphone togenerate a second decoded acoustic signal; and a time-divisionmultiplexer (TDM) to process the first decoded acoustic signal and thesecond decoded acoustic signal and to generate a TDM-processed signal.19. The pair of eyeglasses of claim 16, wherein the binaural audioprocessor further comprises: a noise suppressor to suppress noise fromthe first beamformer signal and the second beamformer signal and togenerate a first noise-suppressed signal and a second noise-suppressedsignal; and a speech enhancer to enhance speech from the firstnoise-suppressed signal and the second noise-suppressed signal togenerate a first clean signal and a second clean signal, wherein thestorage device stores the first and second clean signal.
 20. A method ofgenerating binaural audio content using a head-wearable apparatuscomprising: generating acoustic signals by a first front microphone anda first rear microphone, respectively, wherein the first frontmicrophone and the first rear microphone are encased in a firstmicrophone housing that is coupled to a first stem of the head-wearableapparatus; generating acoustic signals by a second front microphone anda second rear microphone, respectively, wherein the second frontmicrophone and the second rear microphone are encased in a secondmicrophone housing that is coupled to a second stem of the head-wearableapparatus, wherein the first stem and the second stem are coupled toopposite sides of a frame of the head-wearable apparatus; decoding, by afirst audio codec, the acoustic signals from the first front microphoneand the first rear microphone to generate a first decoded acousticsignal; decoding, by a second audio codec, the acoustic signals from thesecond front microphone and the second rear microphone to generate asecond decoded acoustic signal; processing, by a time-divisionmultiplexer (TDM), the first decoded acoustic signal and the seconddecoded acoustic signal to generate a TDM-processed signal, wherein theTDM-processed signal includes the first decoded acoustic signal and thesecond decoded acoustic signal; beamforming the TDM-processed signal bya beamformer, wherein beamforming the TDM-processed signal includesbeamforming the first decoded signal to generate a first beamformersignal, and beamforming the second decoded signal to generate a secondbeamformer signal; and storing by a storage device the first beamformersignal and the second beamformer signal as a two-channel file.
 21. Themethod of claim 20, wherein the first decoded acoustic signal is a pulsecode modulation (PCM) signal based on the acoustic signals from thefirst front microphone and the first rear microphone, and the seconddecoded acoustic signal is a PCM signal based on the acoustic signalsfrom the second front microphone and the second rear microphone.